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Abstract 



A general theory of resource-bounded measurability and measure is developed. 
Starting from any feasible probability measure v on the Cantor space C (the set of all 
decision problems) and any suitable complexity class C C C, the theory identifies the 
subsets of C that are z/-measurable in C and assigns measures to these sets, thereby 
endowing C with internal measure-theoretic structure. Classes C to which the theory 
applies include various exponential time and space complexity classes, the class of all 
decidable languages, and the Cantor space C itself, on which the resource-bounded 
theory is shown to agree with the classical theory. 

The sets that are i^-measurable in C are shown to form an algebra relative to which 
z^-measure is well-behaved (monotone, additive, etc.). This algebra is also shown to 
be complete (subsets of measure sets are measurable) and closed under sufficiently 
uniform infinitary unions and intersections, and z/-measure in C is shown to have the 
appropriate additivity and monotone convergence properties with respect to such in- 
finitary operations. 

A generalization of the classical Kolmogorov zero-one law is proven, showing that 
when V is any feasible coin-toss (i.e., product) probability measure on C, every set 
that is i^-measurable in C and (like most complexity classes) invariant under finite 
alterations must have i/- measure or i^- measure 1 in C. 

The theory is presented here is based on resource-bounded martingale splitting 
operators, which are type-2 functionals, each of which maps N x Du into Du x D^, 
where Di, is the set of all i/-martingales. This type-2 aspect of the theory appears to be 
essential for general z/- measure in complexity classes C, but the sets of z^-measure or 
1 in C are shown to be characterized by the success conditions for martingales (type-1 
functions) that have been used in resource-bounded measure to date. 
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research was performed during several visits at the California Institute of Technology, and much of the 
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1 Introduction 



Resource-bounded measure is a complexity-theoretic generalization of classical measure the- 
ory that interacts informatively and quantitatively with many other much-studied aspects 
of computational complexity. Since its introduction in 1992 [6], resource-bounded measure 
has yielded a rapidly growing body of new results and insights across a variety of subar- 
eas of computational complexity. The recent survey papers [3 [1] summarize many of these 
developments, but the ongoing progress of many investigators is quickly outdating these 
surveys. 

Notwithstanding its productivity to date, the theory developed in [B] can only be regarded 
as a fragment of resource-bounded measure. There are two compelling reasons for this view. 
First, the theory in |6] is restricted to the case where the underlying probability measure is 
the uniform probability measure on the Cantor space C of all languages, i.e., the random 
experiment in which a language A C {0, 1}* is chosen by using an independent toss of a fair 
coin to decide membership of each string in A. Second, the theory in [6] is restricted to the 
sets of resource-bounded measure (and their complements, the sets of resource-bounded 
measure 1). 

Recent work of Breutzmann and Lutz [2], furthered by Kautz [3], has addressed the 
first of these restrictions by investigating the measure-zero fragment of resource-bounded 
u-measme, where the underlying probability measure u is an arbitrary (Borel) probability 
measure on C. Specific results may require u to satisfy certain complexity, independence, or 
positivity conditions, but these requirements arise naturally, not as artifacts of the theory. 

In this paper, we address the second of the above-mentioned restrictions by developing a 
general theory of resource-bounded measurability and measure. Starting from any feasible 
probability measure on C and any suitable class C C C, we identify the subsets of C 
that are //-measurable in C and assign //-measures to these sets, thereby endowing C with 
internal measure-theoretic structure. Classes C to which the theory applies include various 
exponential time and space complexity classes, the class of all decidable languages, and the 
Cantor space C itself. We show that classical //-measure on C is precisely the case C = C of 
the more general theory presented here. 

We show that the sets that are //-measurable in C form an algebra relative to which 
//-measure in C is well-behaved (monotone, additive, etc.). We also show that this algebra 
is complete (subsets of measure sets are measurable), that it is closed under sufficiently 
uniform infinitary unions and intersections, and that //-measure in C has the appropriate 
additivity and monotone convergence properties with respect to these infinitary operations. 

We prove a resource-bounded generalization of the classical Kolmogorov zero-one law 
[5]. This states that, when // is a feasible coin-toss (i.e., product) probabihty measure on 
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C, every set that is z/-measurable in C and is (like most complexity classes) invariant under 
finite alterations must have z^- measure in C or z^- measure 1 in C. 

The theory presented here is not a straightforward extension of the measure- zero fragment 
of resource-bounded measure that has been investigated to date. The basic objects in our 
development here are resource-bounded martingale splitting operators, each of which is a 
type-2 functional mapping N x Dj, into Vj^xV^,, where V^, is the set of all z/-martingales. This 
approach, which can be regarded as a martingale-based, complexity-theoretic generalization 
of the classical Caratheodory definition of measure, entails a variety of new proof techniques. 
This type-2 aspect of the theory appears to be essential in order to achieve the algebraic 
properties mentioned above in complexity classes. However, we show that the sets of v- 
measure or 1 in C are characterized by the same success conditions for martingales (type-1 
functions) that have been used in resource-bounded measure to date. 

The theory presented here extends and deepens the relationship between resource-bounded 
measure and classical measure theory. We expect this to open the way for new applica- 
tions in computational complexity by enabling the adaptation of powerful techniques from 
measure-theoretic probability theory. The theory also opens the way for the investigation of 
complexity classes using probability measures that arc not subject to the Kolmogorov zero- 
one law, thereby accruing the quantitative benefit of measures throughout the interval [0, 1]. 
This may lead to new applications of the resource-bounded probabilistic method, especially 
in situations where the application itself may dictate the use of such a probability measure. 
Finally, we believe that the work presented here highlights the importance of the continuing 
investigation of higher-type computational complexity. 



2 Notation and Functionals 



In this paper, N is the set of nonnegative integers, Q is the set of rational numbers, and M 
is the set of real numbers. 

We write {0, 1}* for the set of all (finite, binary) strings, and we write \x\ for the length of 
a string x. The empty string. A, is the unique string of length 0. The standard enumeration 
of {0,1}* is the sequence Sq = X, Si = 0,S2 = 1,S3 = 00,..., ordered first by length and 
then lexicographically. For x,y G {0,1}*, we write x < y if x precedes y in this standard 
enumeration. For n e N, {0, 1}" denotes the set of all strings of length n, and (0, 1}-" 
denotes the set of all strings of length at most n. 

If x is a string or an (infinite, binary) sequence, and if < i < j < then x[i..j] is the 
string consisting of the i*^ through j^^ bits of x. In particular, x[0..i — 1] is the i-bit prefix of 
X. We write x[i] for a;[i..i], the i*^ bit of x. (Note that the leftmost bit of x is x[0\, the 0**^ 
bit of x.) 
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If is a string and x is a string or sequence, then we write w ^ x if w is a prefix of x, 
i.e., if there is a string or sequence y such that x = wy. 

The Boolean value of a condition (p is |0] = if then 1 else 0. 

We use the discrete logarithm 

logn = min{A; G N|2'' > n}. 

Note that log = 0. 

As in [6j, for each z G N we define a class Gj of functions from N into N as follows. 

Go = {f\mfin)<kn} 
G.+i = 2«'(^°s") = {f\{3g G G,)f{n) < 2^^°^") } 

We also define the functions gi G Gi by go{n) = 2n, gi^i{n) = 2^'^'°s")_ w/"g regard the 
functions in these classes as growth rates. In particular. Go contains the linearly bounded 
growth rates and Gi contains the polynomially bounded growth rates. It is easy to show 
that each Gj is closed under composition, that each / G Gj is o{gi+i), and that each c/i is 
o(2"). Thus Gi contains superpolynomial growth rates for all z > 1, but all growth rates in 
the Gj-hierarchy are subexponential. 

Within the class REC of all decidable languages, we are interested in the uniform complex- 
ity classes = DTIME(2^-i) and E^SPACE = DSPACE (2^-^) for i > 1. The well-known 
exponential complexity classes E = Ei = I)TIME{2^^'^^^^), E2 = DTIME(2Poly^o'^ial), ES- 
PACE = EiSPACE = DSPACE {2^^'^'^^'^), and E2SPACE = DSPACE(2Poly'^o'^ial) g^^g 
particular interest. 

In this extended abstract, our discussion of functions, functionals, and their complexities 
is somewhat informal and is presented in terms of examples. 

Many of the functions in this paper are real-valued functions on discrete domains. A 
typical example might have the form 

/:Nx{0,ir ^M, 

and we often write fk{w) for f{k, w). A computation of such a function / is a function 

/ : N X N X {0,1}* ^ Q 
such that, for all r,k eN and w G {0, 1}*, 



< T 
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The canonical computation of such a function / is the unique computation / of / such that, 
for all r,k eN and w e {0, 1}*, fr,k{w) is of the form a ■ where a is an integer. 

Given a set A, we say that / is ^-computable if there exists / G A such that / is a 
computation of /. For the sets A that we consider in this paper, this is equivalent to saying 
that the canonical computation of / is an element of A. 

We also consider junctionals, whose arguments and values may themselves be real- valued 
functions. A typical example might have the form 

$ : N X ({0, 1}* ^ R) ^ ({0, 1}* R), 

in which case for each A; G N and / : {0, 1}* — > R, the value of $ is a function $fc(/) : 
{0, 1}* — 7> R. Formally, we regard such a functional as operating not on the real-valued 
functions themselves, but rather on canonical computations of these functions, as defined 
in the preceding paragraph. Thus we identify the example functional $ above with (any) 
functional 

: N X (N X {0, 1}* — ^ Q) ^ (N X {0, 1}* — > Q) 

such that, for all A; G N and / : {0, 1}* — > R, if / is the canonical computation of /, then 
$'^(/) is a computation of Note that is a type-2 functional; it is in this sense that 

we regard $ as a type-2 functional. 

If we wish to discuss the computability or complexity of the functional $ above, then we 
curry the functional obtaining a functional 

: N X (N X {0, 1}* ^ Q) X N X {0, 1}* ^ Q 

We then say that is computable if there is a function oracle Turing machine M such that, 
for all A; G N, 5f : N X {0, 1}* Q, r G N, and w G {0, 1}*, M on input (A;, r, w) with oracle 
g computes the value $"(A;, g, r, w) = <^'^{g)r{w) We say that $ is computable if $ is, in the 
above manner, identified with some computable functional Similarly, we say that $ is 
computable in time t{n) if there is an oracle Turing machine M as above that runs in at 
most t{k + r + \w\) steps, and we say that $ is computable in space s{n) if there is an oracle 
Turing machine M as above that uses at most s{k + r -\- \w\) tape cells, including cells used 
for oracle queries and output. 

We use the following classes of functionals. 

1. The class "all," consisting of all functionals of type < 2 in the above sense. 

2. The class 



rec = 1$ G all $ is computable | . 
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3. For each i > 1, the class 



Pi = 



$ G all $ is computable in Gi time 



4. For each i > 1, the class 



PjSpace 



$ G all $ is computable in Gi space 



We write p for pi and pspace for pispace. Throughout this paper, a resource bound (generi- 
cally denoted by A or A') is one of the above classes of functionals. 

As in [6], a constructor is a function 6 : {0,1}* — )■ {0,1}* such that x ^ for all 
X G {0, 1}*. The result of a constructor 6 is the unique language R{6) such that S^{X) ^ R{S) 
for all A; G N, where 5^ is the fc-fold composition of 6 with itself. The result class of a resource 
bound A is the set of all languages R{6) such that 5 is a constructor and S E A. As noted 
in [S], we have 



for all z > 1. 



3 Martingales 

We work in the Cantor space C, consisting of all languages (i.e., decision problems) A C 
{0, 1}*. We identify each language A with its characteristic sequence, which is the infinite 
binary sequence A whose n*^ bit is A[n] = {sn G AJ for each n G N. Relying on this 
identification, we also consider C to be the set of all infinite binary sequences. 

For each string w G {0, 1}*, the cylinder generated by w is the set 



i?(all) = C, 
i?(rec) = REG, 
R{Vi) = E„ 

i?(pi (space) = E, SPACE 



C 



'to 




Note that C 



C. 



A probability measure on C is a function 



: {0,1}* ^ [0,1] 
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such that u{X) = 1 and, for all G {0, 1}*, 



z/(w) = z/(wO) + ^{wl). 

Intuitively, i/{w) is the probability that A G when we "choose a language A E C according 
to the probability measure z/." We sometimes write i^(C^) for u{w). 

If v,w E {0, 1}* and u{w) > 0, then we write 

1 if V \^ w 



v{y \w)=< 



v(v) -r I — 
v[w) — 



otherwise 



for the conditional v-measure of v given w. 

The uniform probability measure jj, is defined by 

for all w G {0, 1}*. 

A bias sequence is a sequence ~^ = {(3^ | G N), where each (3^ G [0, 1]. Given a 
bias sequence ^, the coin-toss probability measure (also called the p -product probability 
measure) is the probability measure ^ defined by 

fJ{w) =11 [{I- ■ (1 - w[k]) + ■ w[k]] 

k=0 

for all w G {0,1}*. Intuitively, ^ [w) is the probability that w ^ A when the language 
A C {0, 1}* is chosen according to the following random experiment. For each string Sk in 
the standard enumeration (sfc | G N) of {0, 1}*, we (independently of all other strings) toss 
a special coin, whose probability is Pk of coming up heads, in which case Sk G A, and I — /3k 
of coming up tails, in which case Sk ^ A. Note that, in the special case where (3k = ^ for all 

k eN, fi^ is the uniform probability measure fx. 

If A is a resource bound, as specified in section |2l then a A-probability measure on C is 
a probability measure p on C with the following two properties. 



(i) I' is A-computable. 
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(ii) There is a A-computable function / : N — t- N such that, for all w G {0, 1}*, z/(w) = 
or u{w) > 2-'(l"'l). 

Note that, if z/ is a A-probability measure on C, then the Boolean value [i^(tf) = 0] is 
A-computable. 

We now recall the well-known notion of a martingale over a probability measure u. Com- 
putable martingales were used by Schnorr |9l [101 IHl [12] in his investigations of randomness, 
and have more recently been used by Lutz [6] and Breutzmann and Lutz [2j in the develop- 
ment of resource-bounded measure. 

If z/ is a probability measure on C, then a u- martingale is a function d : {0, 1}* — )■ [0, oo) 
such that, for all w G {0, 1}*, 

d{w)u{w) = d{wO)iy{'wO) + d{wl)i'{wl). 

The initial value of a //-martingale d is d{X). A A-u-martingale is a //-martingale that is 
A-computable. We reserve the symbol 1 for the unit martingale define by l{w) = w for all 
w G {0, 1}*. Note that 1 is a //-martingale for every probability measure u on C. 

Let d he a. //-martingale, and let A C {0, 1}*. We say that d covers A if there exists 
n G N such that d{A[0..n — 1]) > 1. We say that d succeeds on A if 

limsup d{A[0..n — 1]) = oo. 

n— >oo 

We say that d succeeds strongly on A if 

lim d{A[0..n - 1]) = oo. 

n— >oo 

The set covered by d is the set 

S^ld] = \a 



d covers A 
The success set of d is 

S°°[d] = d succeeds on yl| . 

The strong success set of d is 

5'^[(i] = d succeeds strongly on /ij . 

The set 5"^ [d] is also called the unitary success set of d. 

A prefix set is a language A C {0, 1}* with the property that no element of A is a prefix 
of another element of A. A routine induction on the definition of martingales yields the 
following. 
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Lemma 3.1. If (i is a i^-martingale, then for every prefix set A C {0, 1}*, 

J2d{w)u{w) < d{X). 



An open set in C is any set of the form 

w€A 

for A C {0, 1}*. Every open set can in fact be written in the form Ca, where A is a. prefix 
set. This representation is not unique, but if A and B are prefix sets such that = C^, 
then it is easy to see that 

for every probabihty measure u on C. The v-measure of an open set X C C, given by 



w&A 



where A is any prefix set such that X = Ca, is thus well-defined. 

If d is any z^-martingale, then the set S^[(J\ is open because S^[d] = Ca, where A — 



d{w) ^ l|- Thus the z/- measure i^(S'^[d]) is a well-defined real number. Before proceed- 
ing, however, we note that may fail to be computable, even when d is p-computable. 



Example 3.2. Let (Mj | z e N) be a standard enumeration of Turing machines, and let 

K = |z e N Mi{Q') halts} 

be the diagonal halting problem. For each i e K, let t{i) be the number of steps executed 
by Mi{0'), and let = |oUm ue {0, Let T = UiexTi, and note that T is a prefix 
set. Define d : {0, 1}* [0, oo) by 



1 ii vl w for some v & T 



d{w) — {O if C u> for some v eT 



i otherwise. 
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It is easy to check that d is a p-/i- martingale, where fi is the uniform probabihty measure on 
C. It is also easy to see that 

It follows that fi{S^[d]) is Turing-equivalent to K, and hence not computable. (In fact, 
fi{S^[d]) is a version of Chaitin's random real number Q [3].) 

Even though u^S^ld]) may not be computable, it is always bounded above by the initial 
value d{X). 



Lemma 3.3. For every z^-martingale d, 

u{S^[d]) < d{X). 

Proof of Lemma 13.31 Fix a prefix set A C |iy d{w) ^ l| such that S^[d] = Ca- Then 

u{S^[d]) = J2d{wMw) < d{X) 

weA 



by Lemma 13.11 □ 

If d is A-computable and X C S"^ [d] , then Lemma 13.31 says that we can regard d as an 
explicit, A-computable certification that X does not have //-measure greater than the initial 
value d{X), which is itself A-computable. 

By Lemma [3.3^ no zz-martingale d can cover a cylinder C^u unless d{X) is at least iy{w). 
The following theorem, which is central to resource-bounded measure, says that, for A-u- 
martingales d, this remains true even if we intersect the cylinder with R{A). 



Theorem 3.4 (Measure Conservation Theorem). lfw& {0, 1}* and d is a A-z^-martingale 
such that fl R{A) C S'^[d], then d{X) > u{w). 

Proof of Theorem 13.41 Assume that w G {0, 1}* and d is a A- z/- martingale such that 
d{X) < u{w). It suffices to exhibit a constructor 5 G A such that R{6) G Cw — S^[d]. 

First note, for every prefix w' C w, the definition of z/-martingales(applied inductively) 
tells us that 

d{w')iy{w') < J2 d{u)u{u) = d{X)u{X) 

\u\ = \w'\ 

= d{X) < iy{w) < iy{w'), 
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so d{w') < 1. In particular, then fix a constant m G N such that d{w) < 1 — 2^ 

Let be a A-computation of d. Using d and the constants w and m, define 6 : {0, 1}* — )■ 
{0, 1}* by 

w if x'^w 

6{x) = < xO if da(x)ixO) < da(x)ixl) and note x'^w 
xl otherwise, 

where a{x) = + m + 2. It is clear that 5 is a constructor, 5 G A, and R{6) G C^. 

For any string x such that w ^ x, the definition of 6 and the fact that d is a z^-martingale 
ensure that 

d{6{x))<daixMx)) + 2~-^''^ 

= min 4(,)(x6) + 2-'^(^) 



< min d(xb) + 2^~'''^^'> 
fee{o,i} 



It follows that, for all A; G N, 



k-l 

(j+m+l) 



d{6\w)) < + ^2 

j=0 

< d{w) + 2-"^ 

< 1 - 2"™. 

Since every prefix of R{S) is either a prefix of it; or of the form S^{w) for some G N, we 
have now shown that R{S) ^ S^[d], completing the proof. □ 

A i^-martingale is regular ii, for all v,w & {0, 1}*, if iy{v) > 1 and v ^w, then ^{w) > 1. 
It is often technically convenient to have a uniform means of ensuring that martingales are 
regular. The following lemma provides such a mechanism. Let A be a resource bound, as 
specified in section [21 and let be a probability measure on C. 

Lemma 3.5 (Regularity Lemma). There is a functional 
with the following properties. 
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1. For all d G V^, A{d) is a regular z^-martingale such that A{d){X) = d{X) and S^[d] C 

2. A(l) = 1. 

3. If z/ is a A-probability measure on C, then A is A-computable. 

Proof of Lemma I3.5( sketch) Given a G (0, 1), it is convenient to have notations for the 
a-weighted averaging function 

m„ : ^ M 
ma{s, t) = as + (1 — a)t, 

the half-plane 

= |(s,f) G rn„(s,t)>l} 



and the region 

The "Robin Hood function" 

is then defined as follows. 

(i) If {s,t) G [0,1]2, then 

(ii) If {s,t) G Ha, then 



Da = H^U [0, oo)^ 
rha : Da [0, oo)^ 



rha{s,t) = (s,t). 



rha{s,t) = {mais,t),mais,t)). 

(iii) If G Da — Ha and s > 1, then 

rha{s,t) = (1, ^ ). 

(iv) If (s, t) e Da - Ha and t > 1, then 

, . ,^ ,ma{s,t-l) 

rha{s,t) = ( ,1). 

a 

We also use the notation rha{s,t) = {rha\s,t),rha\s,t)). 

The following essential properties of the Robin Hood function rha are routine to verify. 

1. The transformation rha is a continuous, piecewise linear mapping from Da into [0, oo)^. 

11 



2. The transformation rha preserves a-weighted averages, i.e., ma{rha{s,t)) = ma(s,t) 
for all (s, t) G Da- 

3. The transformation rh^ maps into [l,oo)^. That is, if the average ma{s,t) is at 
least 1, then rha "steals from the richer and gives to the poorer" of s and t so that 
both rha\s,t) and rha\s,t) are at least 1. 

4. For all {s,t) G Da, rha\s,t) > min{l,s} and rha\s,t) > min{l,t}. That is, the 
transformation rha never "steals" more than the excess above 1. 

5. The transformation rha leaves points of [0, 1]^ unchanged. 

Using the Robin Hood function, we define the functional A : — )■ V,y as follows. 
For d G V^, we define the z/- martingale A{d) by the following recursion. (In all clauses, 
w G {0,1}* and b G {0,1}.) 

(i) A{d){X) = d{X). 

(ii) If iy{w) = or u{wb \ w) G {0, 1}, then A{d){wb) = A{d){w). 

(iii) If u{w) > and < iy{wb \ w) < 1, then 

A{d){wb) = r/i[^^(^^o|^)(c/oH, c/iH), 
where gb{w) = A{d){w) — d{w) + d{wb). 

It is now routine (if tedious) to verify that A has the desired properties. □ 



4 Measure 

In this, the main section of the paper, we develop the general theory of resource-bounded 
measurability and measure in complexity classes. Throughout this paper, A and A' are 
resource bounds, as specified in section [2], and is a probability measure on C, as defined 
in section [3l 

The fundamental objects in resource-bounded measure are martingale splitting operators. 
If and X~ are disjoint subsets of C, then a martingale splitting operator for and 
X~ is a type-2 functional that, given a martingale d and error tolerance 2"'', "splits" d into 
two martingales d'^ and d~ such that d^ covers every element of X^ covered by d, d~ covers 
every element of X~ covered by d, and the sum of initial values (i.^(A) + d^{X) does not 
exceed the initial value d{X) by more than 2~^. The formal definition follows. 
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Definition. If and X are disjoint subsets of C, then a v- splitting operator ior {X^ , X ) 
is a functional 

$ : N X ^ X P^, 

where we write 

$(r,(i) = ($+(d),$;(rf)), 
such that the following conditions hold for all r G N and d G V^,. 

(i) x+ns^[d]cs'[<i>t{d)], 

(ii) x-ns^[d] cs'[<^;id)], 

(iii) $+(rf)(A) + $-(rf)(A) < d{X) + 2-\ 

A A-u- splitting operator for {X~^,X~) is a z^-splitting operator for {X~^,X~) that is A- 
computable. 

The resource-bounded measurement of sets, both globally and in -R(A), is now defined 
in terms of splitting operators. 

Definition. Let X C C. 

1. A A-u- measurement of X is a A-z/-splitting operator for {X,X^). 

2. A ly- measurement of X in R{A) is a A-z/-splitting operator for (-R(A) flX, R{A) — X). 

If C X~^ and Y~ C then every i^-splitting operator for {X~^,X~) is clearly a 
z^-splitting operator for {Y^,Y^). In particular, then, every A- //-measurement of X is a 
zz-measurement of X in R{A). As we shall see, the converse is (fortunately) not true. 

We now develop some basic properties of //-measurements. Recall the unit martingale 1 
from section [3l 

Lemma 4.1. Let X C C. If $ and are //-measurements of X in R{A), then for all 
J, A; G N, 

$;(i)(A) + vi/-(i)(A)>i. 

Proof of Lemma 14.11 Assume the hypothesis, let j, A; G N, and let 

rf = $;(i) + v[/^-(i). 
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Then d is a A-z^-martingale and 

R{A) = {R{A) n X) U {R{A) - X) 

so d{X) > 1 by the Measure Conservation Theorem. □ 
Notation. If $ is a zz-sphtting operator, then we write 

*i = inf$+(l)(A), 
$^ = inf<|.;(l)(A). 



Lemma 4.2. Let X C C. If $ is a zy-measurement of x in i?(A), then + = 1 and, 
for all r G N, 

<$+(l)(A)<$+ +2-'^ 

and 

$- <$;(l)(A)<<|.;, + 2-^ 
Thus $+(l)(A) — ^ $+ and $-(l)(A) ^ <l>^ as r ^ oo. 



Proof of Lemma 14. 2 1 Assume the hypothesis. It follows immediately from Lemma [4. II that 
+ <I>;;^ > 1. Also, for any r G N, 

C + '^'oo<'^'.+ (l)(A) + <f;(l)(A) 
< 1(A) + 2-'' 
= 1 + 2-'\ 

so $+ + $^ < 1. Thus $+ + $^ = L 

Now fix r G N. Then, by the definitions of $+ and $+ < <I>+(1)(A) and < 
Kim)- Also, 

= $,+(i)(A) + <|.;(i)(A)-i 

< 1(A) + 2-" - 1 

= 2-^ 

so $+(l)(A) <<!>++ 2'^ and $r(l)(A) < -l-^ + 2"^ □ 
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Lemma 4.3. Let X C C. If $ and \1/ are i^-measurements of X in i?(A), then for all r G N, 

|$+(l)(A)-vl/+(l)(A)|<2~^ 

and 

|<^'7(l)(A)-*.-(l)(A)|<2-. 
Thus $+ = and = . 

Proof of Lemma 14.31 Assume the hypothesis, and let r G N. Then, by Lemma I4.H 

1<$+(1)(A) + M/;(1)(A) 
<$+(l)(A) + (l(A) + 2--vI/+(l)(A)), 

so ^+(1)(A) < $+(l)(A) + 2-\ Similarly, $+(l)(A) < ^+(1)(A) + 2-^ so 

|$+(l)(A)-^+(l)(A)|<2-. 

The proof that 

\^-m\)-K{i){\)\<2-^ 

is similar. □ 

We now have the machinery we need to give unambiguous definitions of resource bounded 
measure. 

Definition. A set X C C is v-measumhle in R{A), and we write X G J^'^i^^y if there exists 
a z^-measurement $ of X in i?(A). In this case, the v-measure of X in R{A) is the real 
number z^(X | R{A)) = $+. (By Lemma |473| u^X \ R{A)) does not depend on the choice 
of $.) 

Definition. A set X C C is A-v- measurable, and we write X G J\^,if there exists a A-p- 
measurement $ of X. In this case, the A-u-measure of X is the real number UAiX) = 
(By Lemma [4.31 h'AiX) does not depend on the choice of $.) 

An intuitive remark on these definitions is in order here. As noted in section [3l a mar- 
tingale d that covers a set X can be regarded as an explicit certification that X does not 
have measure greater than the total value d{X). Thus, if we apply a measurement $ of X 
to the unit martingale 1, then the resulting martingales $^(1) and $~(1), for r G N, can 
be regarded collectively as an explicit certification that X does not have measure greater 
than or less than 1 — = . This is clearly a necessary condition for measurability 
but we require further that the measurement $ split arbitrary martingales (which may be 
more exotic and of lesser total measure than 1) in analogous fashion. The utility of this 
requirement is evident in the proof of Theorem I4.12[ where we establish that the measurable 
sets form an algebra over which measure is additive. 
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In general, when we make an assertion of the form 'V(X | -R(A)) = a," it is imphcit that 
X is z^- measurable in i?(A). On the other hand, an assertion of the form | i?(A) 7^ a" 

is the negation of 'V(X | i?(A)) = a," and thus means that either X is not z^- measurable 
in -R(A) or u{X \ i?(A)) = /3 for some (3 ^ a. Similar remarks hold for the assertions 
'Va(X) = a" and 'Va(X) 7^ a." 

The following two lemmas are now very obvious, but also very useful. 
Lemma 4.4. Let X C C. 

1. If X is z^-computable in -R(A), then for every z^-measurement $ of X in -R(A) and 
every r G N, 

v{X I M(A)) < $+(l)(A) < u{X I i?(A)) + 2-' 

2. If X is a A-z^-computable, then for every A-z^-measurement $ of X and every r G N, 

v^{X) < $+(l)(A) < u^iX) + 

Lemma 4.5. Let X C C. 

1. If X is A-z^-measurable and A C A', then X is A'- z^- measurable and ^/^'{X) = ua{X). 

2. If X is A- //-measurable, then X is z^-measurable in i?(A) and z^(X | -R(A)) = z/a(X). 

3. X is z/- measurable in i?(A) if and only if X fl R{A) is z/- measurable in i?(A), in which 
case z/(X | R{A)) = p{X n i?(A) | i?(A)). 

Before proceeding further, we show that resource-bounded measure is a generalization of 
classical measure theory. More precisely, classical measure theory is the special case A = all 
of resource-bounded measure. We first recall the classical definitions (specialized to the 
Cantor space C.) 

Recall the definitions of open sets and their measures in section [31 

Definition. The outer v-measure of a set X C C is 

v*{X) = inf |z/(y) Y is open and X C y| . 



Note that the outer z/-measure i^*{X) is defined for every set X C C, and that < 
iy*{X) < 1. It is well known that outer measure is subadditive, i.e., that 

z/*(Xur) < u*{X) + u*{Y) 
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for all X,Y CC. 

Definition. A set X C C is v-measurahle if, for every set y C C, 

y*{Y) = p*{Yr\X) + p*{Y - X). 
In this case, the v-measure of X is 

v{X) = u\X). 



Since the outer measure is subadditive, it is evident that a set X C C is i/-measurable 
if, for every set y C C, 

v*iY) > iy*{Y nX) + u*{Y - X). 



We now show that classical measurability and measure are the special case A = all of 
resource-bounded measure. 



Theorem 4.6. A set X C C is all- //-measurable if and only if it is z/- measurable, in which 
case z/aii(X) = f^X). 



Proof of Theorem 14.61 Assume first that X is all-z/-measurable, and let $ be an all-z/- 
measurement of X. To see that X is //-measurable, let F C C be arbitrary. As noted above, 
to show that X is //-measurable, it suffices to prove that 

u*{Y) > iy*{Y nX) + u*{Y - X). 

For this purpose, let r G N be arbitrary. Then there is a prefix set A C {0, 1}* such that 
Y CCa and u{Ca) < Jy*{Y) + 2~(''+i). Define d : {0, 1}* ^ [0, oo) by 

{^ueA^iu\w) if //(«;) >0 
1 if iy{w) = 0. 

Then d is a //-martingale and Y C S'^[d], so 

Ynx c s^[d]nx c s^[<^^+^{d)]. 

Since S'^[$^_,_]^((i)] is open, it follows by Lemma [3.31 that 

u*{YnX) < //(5M<f++i(rf)]) < <f++i(rf)(A). 
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A similar argument shows that 

u*{Y-X)<<^;^,{d){X). 

We thus have 

u*(Y nX) + u*(Y -X) < $++i(rf)(A) + K+MW 

< d{X) + 2-(^-+i) 
= z/(Ca) + 2-('^+i) 

< u*(Y) + 2'''. 

Since r G N is arbitrary here, this shows that 

u*{Y) > iy*{Y nX) + u*{Y - X), 
confirming that X is //-measurable. 

If we let y = C in the above argument, then d = 1 and we have 

KX) = z/*(cnx)<$,^i(i)(A) 

for all r G N, so 
Similarly, 

1 - uiX) = u{X^) = u*{C -X)< $-+i(l)(A) 



for all r G N, so by Lemma [4.21 

l-K^)<$oo = l-C = l-'^allW, 

SO Z/all(^) = y{X). 

Conversely, assume that X is //-measurable. Define 

as follows. Let r G N and d G "D^. Since S^[d] is open, we know that S^[d], S^[d] fl X and 
S'^[d] — X are i/-measurable, with 

v{S[d]) = u{S[d] nX) + u{S[d] - X). 

Fix prefix sets A"*", A~ C {0, 1}* such that 

S^[d] nx c Ca+, z^(Ca+) < iyiS[d] nx) + 2-("+i), 
[d]-XC Ca- , lyiCA- ) < i^iSld] -X) + 2-("+i) . 



For a e {+, -}, define by 
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if //(«;) = 0. 



It is clear tliat tlie functional $ so defined is all-computable (a vacuous condition) and maps 
N X "Dj, into "Dj, x V^. To see that $ is an all- //-measurement of X, let r G N and d G V,^. 
Three things are to be verified. 

1. S'^[d] nX C To see this, let B e S^[d] n X. Then B e Ca+, so there exists 

w G such that w ^ B. If z/(w) > 0, then 



ueA+ 

so > 1 in any case, whence B G S'"'^[$^((i)]. 

2. S^[d] — X C S'^[$~((i)]. The verification is analogous to that of 1. 

3. $+((i)(A) + <^;{d){X) < d{X) + 2-'-. To see this note that 

^tmx) + ^;.{d){\) 



by Lemma I3.3[ 

We have now shown that $ is an all-z/-measurement of X, whence X is all-z/-measurable. 



In the classical case, two definitions of z/-measurability are frequently used. (See Royden 
[8j for example.) The definition we have used above is known as the Caratheodory defi- 
nition. The other definition frequently used is the Lebesgue definition, which is stated in 
terms of equality of inner and outer measures. These two definitions are known to be equiv- 
alent in the classical case. Our definition of A- z/-measur ability in terms of A-computable 
splitting operators is motivated by the classical Caratheodory definition, and the proof of 
Theorem 14.61 articulates this motivation more precisely. Corollary 15.51 below suggests that 
resource-bounded measurability in complexity classes does not have an equivalent definition 
in the style of Lebesgue. 

We now note that the A-measures of A-measurable sets must themselves be A-computable. 




= KCa+) + KCa-) 

< u{S^[d] n X) + u{S^[d] -X) + 2-" 
= p{S^[d]) + 2-'- 

< d{X) + 2-' 



□ 



19 



Theorem 4.7. Let X C C. 



1. If X is //-measurable in i?(A), then iy{X \ R{A)) is A-computable. 

2. If X is A- //-measurable, then z/a(^) is A-computable. 

Proof of Theorem 14.71 It suffices to prove 1, since 2 then follows by part 2 of Lemma [4.51 

Assume that X is z/-measurable in i?(A) with the //-measurement $ as witness. Let 
be a A-computation of and define / : N — )■ Q by 

/W = $^,v.+i(l)(A). 
Then / is A-computable and, for all r G N, Lemma 14.41 tells us that 
\f{r)-uiX\R{A))\ 

< \f{r) - <f++i(l)(A)| + |«f.V(l)(A) - u{X I R{A))\ 

< 2-('^+i) + 2-(^'+i) 

= 2-^ 

so / is a A-computation of z/(X | i?(A)). □ 

Our next step is to show that cylinders are A-z/-measurable, provided that u itself is a 
A-probability measure, as defined in section [3l 

Lemma 4.8. If z/ is a A-probability measure on C, then for each w G {0, 1}*, the cylinder 
is A-z/-measurable, with lyAiCw) = u^w). 



Proof of Lemma 14.81 Assume the hypothesis, and let w G {0, 1}*. We have two cases. 



I: ^{w) = 0. (Note that w X in this case because //(A) = 1.) Then define 

$ : N X -> X "D^ 
as follows. For each r G N, d G V^, and v G {0, 1}*, set 



1 a w ^ V 

otherwise, 

<^;{d){v) = d{v). 



It is clear that $ is A-computable and that (d) G for all r G N and 

d G Also, for all r G N and d G V^, the following conditions hold. 



20 



(i) s'[d]nc.,,cc^ = s'[^+{d)]. 

(ii) S'[d]^a^cs'[d] = S'[<^;{d)]. 

(iii) $+(d)(A) + $-(d)(A) = d(A). 

Thus $ is a A- i^- measurement of C^, so is A-i/-measurable, with 

= *o+(l)(A) 
= 

= 1/(10). 

II: u{w) > 0. In this case, define 

as follows. For each d E T>^ and v e {0, 1}*, set 

{d{w)v{w \v) \l V 
d{v) \iwQv 
otherwise, 
^-{d){v)^d{v)-^+{d){v). 



Then define 

by 



where A is the functional given by the Regularity Lemma. It is clear that ^ is A- 
computable. 

Let d e Vj,. It is routine to check that e Vj^. Also, for v Qw, 

d{w)u{w) < d{u)p{u) = d{v)u{v), 

\u\=\w\ 

so d{w)v{w I v) < d{v). It follows readily that ^^{d){v) < d{v) for all v e {0,1}*, 
whence G Vy. This confirms that ^ maps N x into x P,^. 

Now let r e N and d e P,.. 
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To see that S^[d] n C S^[^+{d)], let A e S'^[d] n C^. Then A e S^[A{d)] n C^, so 
there exists n > \w\ such that w C y4[0..n — 1] and A{d){A[0..n — 1]) > 1. Then 

^+(rf)(A[0..n - 1]) = <l>+(A(rf))(A[0..n - 1]) 
= A{d){A[0..n-l]) 

>1, 

so A G S'[^+{d)]. 

To see that S^[d] - C S^[^;{d)], let A G S^fd] - C^. Then A G Si[A(d)] - C^, so 
there exists n > \w\ such that A{d){A[0..n — 1]) > 1 and neither of w, A[0..n — 1] is a 
prefix of the other. Then <l>+(A((i))(A[0..n - 1]) = 0, so 

^;id){A[0..n - 1]) = $-(A(rf))(A[0..n - 1]) 
= A{d){A[0..n-l]) 
>1, 

so A G S'[^;{d)]. 
Finally, note that 

= A{d){X) 
= d{X). 

We have now shown that \& is a A-z/-measurement of C^. The A-z/-measure of is 
then 

= <|.+ (A(1))(A) 
= <|.+ (1)(A) 
= l{w)h'{w I A) 
= z/(w). 

□ 

Lemma [4.81 has important consequences for measure in i?(A), as shown by the following 
corollaries and example. 

Corollary 4.9. If i/ is a A-probability measure on C, then for each w G {0, 1}*, the cylinder 
C^u is z/-measurable in -R(A), with 1/(0^ \ -R(A)) = ly^w). 
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Proof of Corollary 14. 91 This follows immediately from Lemma and part 2 of Lemma 
□ 

Corollary 4.10. If z/ is a A-probability measure on C, then R{A) is z^-measurable in R{A), 
with iy{R{A) \ R{A)) = 1. 

Proof of Corollary 14.101 This follows immediately from Corollary 14.91 with w = X. □ 

Example 4.11. Consider the uniform probability measure /i on C and the set REC, con- 
sisting of all decidable languages. By Corollary 14.101 (with u = n and A = REC), REC is 
//-measurable in REC, with /i(REC | REC) = 1. On the other hand, REC is countable, so 
REC is (classically) //-measurable, with //(REC) = 0. Since //(REC | REC) ^ /i(REC), it 
follows by Lemma [4.71 and parts 1 and 2 of Lemma [4.51 that REC is not rec-/i- measurable. 
This example shows that the converses of parts 1 and 2 of Lemma 14.5! do not hold. 

The rest of this section is devoted to showing that resource-bounded measurability and 
measure are well-behaved with respect to set-theoretic operations. 

Definition. Let C C. An algebra on R is a collection J-" of subsets of C with the following 
three properties. 

(i) ReJ^. 

(ii) If X G J", then X= G 

(iii) If X, y G then X U F G J". 

If J-" is an algebra on R, then a subalgebra of T on R is a set £ J-" that is also an 
algebra on R. 

In this paper, we only use the above definition in cases where R = C or R = R{A). In the 
latter case, our terminology is somewhat nonstandard, in that we allow an algebra on R{A) 
to have elements that are not themselves subsets of R{A). Our terminology is in accordance 
with past usage in resource-bounded measure, where it is often convenient to speak of "the 
measure of X in i?(A)" (e.g., the measure of P/Poly in ESPACE) in cases where X is not 
a subset of R{A). In any case, if one so prefers, it is a straightforward matter to define the 
notion of an algebra in R{A), and to adapt the results here to this notion. 
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Theorem 4.12. The set ^^(/^), consisting of all sets that are i/-measurable in R{A), is an 
algebra on -R(A). For X,Y E ^^(/j^), we have 

z/(X= I R{A)) = l-u{X\ R{A)) 

and 

iy{XUY \ R{A)) = v{X \ R{A)) + u{Y \ R{A)) -iy{XnY \ i?(A)). 

Proof of Theorem mH By Corollary glOl R{A) G J^^^^y 

Assume that X G ^^(^)- Then there is a z^-measurement $ of X in R{A). Define 

vl/+(d) = 
vI/;(c/) = $+(d) 

It is easily verified that is a i^- measurement of X^ in R{A), so X'^ G -^^(^) and, by 
Lemma 14.21 

u{X^ I R{A)) = ^to = {<f oo 

= l-iy{X\ i?(A)). 

Now assume that X,Y E ■^r{a)- ^ ^^'-^ ^ //-measurements of X and y, respec- 
tively, in R{A). For each a, 6 G {+, — }, define the functional 

e[ab] -.NxV^^V^ 

by 

e[a6],(d) = vl/^+2(<^>:^+i(rf))- 

It is clear that each of the four functionals Q[ab] so defined is A-computable. For all r G N 
and d G V^, our choice of $ and gives us the inclusions 

R{A) n (X n F) n s^[d] c s^[e[++]r{d)], 
R{A) n{x -Y)n s^[d] c 5^[e[+-],(d)], 
R{A) n{Y-x)n s^[d] c s^[Q[-+]r{d)], 
R{A) n (X u YY n ^^[(i] c s^[e[ — 
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and the bound 



e[++Ud)ix) + e[+-Ud){\) + e[-+Ud){x) + e[—Ud){x) 

<<^'++i(rf)(A) + $;+i(rf)(A) + 2-('-+i) 
< rf(A) + 2"^ 

It follows that the functionals 

e[x] = {&[++] + e[+-], e[-+] + e[— ]), 
e[Y] = (e[++] + 0[-+], 0[+-] + 0[— ]), 
e[x nY] = {&[++], &[+-] + e[-+] + e[— ]), 
e[x uY] = (0[++] + e[+-] + 0[-+], 0[— ]) 

are /^-measurements of X ,Y, X (1 Y, X U Y, respectively, in i?(A). Thus X (lY and X UY 
are //-measurable in R{A), with 

u{XUY\ R{A)) + u{XnY\ R{A)) 

= lim Q[X U F] + (1)(A) + lim e[X n Y]+{1){X) 



y lim eH,(l)(A) 



1 — >oo 
a,6G{+,-} 



lim e[X] + (l)(A) + lim e[y] + (i)(A) 

r— >oo r— >oo 

u{X I R{A)) + u{Y I i?(A)). 



□ 



The following immediate consequence of Theorem 14.121 says that measure in i?(A) is 
additive and monotone. 



Corollary 4.13. Let X,Y e J^^^^y 

1. If X n y n R{A) = 0, then 

i^{XUY\ R{A)) = u{X I R{A)) + u{Y \ R{A)). 

2. If X n R{A) C y, then i^{X \ R{A)) < v{Y \ R{A)). 



The following analogs of Theorem 14.121 and its corollary are proven in similar fashion. 
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Theorem 4.14. The set J-"^, consisting of all sets that are A-z^-measurable, is an algebra 
over C. For X, F G J-^, we have 

Z/Am = l-//A(X) 

and 

ua{X UY) = UAiX) + UAiY) - ua{X n Y). 

Corollary 4.15. Let X,Y e J'X- 

1. If X n y = 0, then 

z^A(xuy) = z/a(x) = z/A(y). 

2. If X C Y, then UAiX) < UAiY). 

Note that by Example 14.111 J^/^^. ^ -^rec -^rec is not an algebra over REC. 

An important property of classical measurability is its completeness, which means that all 
subsets of measure-0 sets are measurable. We now show that resource-bounded measurability 
also enjoys this property. 

Definition. Let J-" be a subalgebra of ^^i^a) "-"^ -R(A). Then J-" is v- complete on -R(A) if, 
for all X, F C C, if X C r G and v{Y \ R{A)) = 0, then X e 

Definition. Let J-" be a subalgebra of J-" a on C. Then J-" is A-u- complete if, for all X, 1" C C, 

if X C y e and UAiY) = 0, then X e 

Theorem 4.16. 

1. The algebra ^^(a) z^-complete on -R(A). 

2. The algebra J^a is A-zz-complete. 



Proof of Theorem 14.161 To prove part 1, assume that X C Y E T and u{Y \ i?(A)) = 0. 
Let \I' be a z/- measurement of Y in i?(A). Define 

<l>,(d) = (vl/+(l),rf). 

It is easy to check that $ is a //-measurement of X in R{A), whence X G ^^(a)- 

26 



The proof of part 2 is identical. 



□ 



The rest of this section concerns infinitary unions and intersections of resource-bounded 
measurable sets. Classical measure is countably additive, which means that the union of a 
countable collection of disjoint measurable sets is measurable, and the measure of the union 
is the sum of the measures of the disjoint measurable sets. However, this property does not 
hold for arbitrary resource bounds A. For example, if A = p or A = rec, then i?(A) can be 
written as a countable union of singleton sets, each of which has A-/i-measure |6], hence 
//-measure in R{A). The union of these singletons, R{A), has //-measure 1 in R{A) - 
exceeding the sum of the /f-measures of the singletons - and is not A-//- measurable at all. 
Thus any resource-bounded analog of countable additivity must involve a restricted class of 
countable unions. 

The obvious approach is to restrict attention to countable sequences of sets that are not 
only individually measurable, but for which there is a uniform witness of their measurability. 
This leads to the following definitions. 

Definition. Let J-" be a subalgebra of ^^(/^) on R{A). A A-sequence in is a sequence 
{Xk I A; G N) of sets X/^ G J-" for which there exists a A-computable functional 

such that, for each A; G N, $fc is a //-measurement of X^ in R{A). 

Definition. Let J-" be a subalgebra of J-"^ on C. A A-sequence in is a. sequence {X^. \ k G 
N) of sets Xk G J-" for which there exists a A-computable functional 

such that, for each A; G N, $fc is a A- //-measurement of X^.. 

Although these definitions are useful for our purposes here, the following example shows 
that they are not sufficient. 

Example 4.17. Let (Mj | i G N) be a standard enumeration of Turing machines. Using 
the standard enumeration {sj | j G N) of {0,1}* and a standard pairing bijection <,>: 
N X N — > N, define a sequence {Xk | A; G N) as follows. For k =< i,j >G N, if Mi{0') halts 
in exactly \sj\ steps, then let = Cqus ; otherwise, let X^ = 0. Since the construction in 
the proof of Lemma 14.81 is easily uniformized, it is not hard to show that {Xj. | A; G N) is a 
p-sequence in J^^. Let X = [J'^^qX^. Then the sets Xo,Xi, . . . are disjoint, so 

oo ^ 

//(X) = J]//(X,) = -J]2-\ 

k=0 ieK 
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where 



K= UeN 



Mi{0') halts 



is the diagonal halting problem. It is thus clear that fi{X) is Turing-equivalent to K, hence 
not computable. (In fact, fJ^iX) is a version of Chaitin's random real number f2 [3j.) It follows 
by Lemmas 14.51 and 14.71 that X ^ F^^^. We thus have a p-sequence of disjoint elements of 



J-"^ whose union is not an element of J-"^. 



The set X of Example 14.171 fails to be rec-/i-measurable because the sum Y1T=q f^i-^k) 
converges too slowly. The following technical definition prohibits such phenomena. 

Definition. A functional 

is /S.- modulated if the sequences {(^1^{d){w) \ k G N), for a G {+, — }, r E N, d E V^, and 
w G {0, 1}*, are uniformly A-convergent. Equivalently, $ is A-modulated if there is a A- 
computable functional 

r : N X N X X {0,1}* 
such that, for all a G {+, — }, t,r E N, d E V^, w G {0, 1}*, and k > T{t, r, d, w), 

where the limit ^'^ j.{d){w) = limk^oo ^k,rid){w) is implicitly assumed to exist. 

We now define the restricted infinitary unions and intersections with which we deal. 
Definition. Let J-" be a subalgebra of J^'^(/^) on /2(A). 



1. A union A-sequence in is a sequence {Xk | A; G N) of sets G J-" for which 
there exists a A-modulated functional $ such that ^'l^{d){w) is nondecreasing in k, 

^^^.{d){w) is nonincreasing in k, and $ testifies that ^Uj=o \ ^ E is a A-sequence 
in J-". 

2. An intersection A-sequence in is a. sequence {X^ | A; G N) of sets X^. G J-" for 
which there exists a A-modulated functional $ such that ^^^{d){w) is nonincreasing 

in k, ^^^(d){w) is nondecreasing in k, and $ testifies that ^nj=o | A; G N j is a 
A-sequence in J^. 

3. J-" is closed under A-unions if IJfcLo"'^'^ ^ every union A-sequence {Xk | G N) 
in J-". 

4. J-" is closed under A- intersections if Ct^^^Xk G T for every intersection A-sequence 
{Xk\ke N) in 
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The motivation for these definitions will be discussed further in the final version of this 
paper. We note in the next lemma that, when the sets have resource-bounded measure 
0, every A-sequence is already a union A-sequence. 



Lemma 4.18. Let J-" be a subalgebra of ^^(^-j on R{A). If {X^ | A; G N) is a A-sequence in 
J-" and | -R(A)) = for all G N, then (X^ | A; G N) is a union A-sequence in J-'. 

Proof of Lemma 14.181 Assume the hypothesis, and let $ be a witness that {X^ | G N) is 
a A-sequence in J-". Then the functional 



The following easy de Morgan law is useful. 

Lemma 4.19. Let be a subalgebra of ^^(a) on i?(A). Then a sequence {Xk \ k E N) 
is a union A-sequence in J-" if and only if the complemented sequence {X^ | A; G N) is an 
intersection A-sequence in J-". Thus J-" is closed under A-unions if and only if J-" is closed 
under A-intersections. 

Proof of Lemma 14.191 It is clear that ($+, <l>^) testifies that {X^ | A; G N) is a union A- 
sequence in if and only if ($~, $+) testifies that {X^ | A; G N) is an intersection A-sequence 



We now show that measure in i?(A) is well-behaved with respect to A-unions and A- 
intersections. 

Theorem 4.20. 

1. ^^(A) is closed under A-unions and A-intersections. 

2. If (Xfc I A; G N) is a union A-sequence in ^^c^-,, then 



\j=o / 
is easily seen to testify that [X^ | A; G N) is a union A-sequence in J-". 




□ 



in J-'. 



□ 



oo 



y{VJT=,Xk I i?(A)) <Y,^{Xu I i?(A)), 



fc=0 



with equality if the sets Xq, Xi, . . . are disjoint. 
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3. If {Xk I /c G N) is a union A-sequence in ^^(^^ with each Xk C X^+i, then 

z^(U~oXfc I i?(A)) = hm v{Xk I i?(A)). 

4. If (Xfc I G N) is an intersection A-sequence in ^^(^^ with each X^+i C X^, then 

z.(nr=o^fc I ^(A)) = hm v{Xk I i?(A)) . 

Proof of Theorem 14.201 Let {Xk | A; G N) be a union A-sequence in ^^(^j^), with the 
functional $ as witness, and let X IJfc^o"'^*:- -^^^ ^ functional F testifying that $ is A- 
modulated, and define a functional 

by 

e+(d)H = $+,,+i(d)H 

and 

Q;{d){w) = <l>-^,+i((i)H, 

where m = r(r + 1, r + 1, d, A). By our choice of $ and F, G is a well-defined, A-computable 
functional mapping N x V^, into V^, x Pj,. To see that G is a /^-measurement of X in -R(A), 
let r G N and G I^jy, and note the following three things. 



1. R{A) nXn S'^ld] C S'^[Q+{d)]. To see this, let A G R{A) nXn S^[d]. Then there 
exists A; G N such that 

A G i?(A) n (u)-o'^.) n ^ s'[<t>l^,id)] 

2. i?(A) n n S^[d] C 5i[G-(d)]. To see this, let A G R{A)nX^ n ^^[d]. Then, writing 
m = r(r + l,r + A), we have 

A Gi?(A) n {i^fJo'-XjY n 
= s'[e;{d)]. 

3. G+(d)(A) + G-(d)(A) < d{X) + 2-^ To see this, let m = r(r + 1, r + 1, d, A). Then 

G+(d)(A) = <l>+,,+,(d)(A) 

<<.+i(^)(A) + 2-(^'+i), 
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so 



e+{d){x) + e;{d){x) 

< d{X) + 2~'\ 

We have now shown that B is a /^-measurement of X in i?(A), whence X G ^^(a)- This, 
together with Lemma 14.191 proves part 1 of the theorem. 

Since G is a z^- measurement of X in -R(A), Theorem 14.121 and its corollary (applied 
inductively) tell us that 



oo 



V 



MXfc|i?(A) = hm e+(l)(A) 

hm hm <l>+,+i(l)(A) 

r— >-oo fe— >oo 



hm hm <l>+,+i(l)(A) 



lim I J Xj I i?(A) 



fe-1 

fc— >oo 



j=0 



< hmJ^K^, |i?(A)) 



j=0 

oo 

= J^K^fc|i?(A)), 

fc=0 

with equality if the sets Xq,Xi, . . . are disjoint. This proves part 2 of the theorem. 

To prove part 3 of the theorem, let [X^ | A; G N) be a union A-sequence in ^^(^-j with each 
Xk C Let lo = -^0 and, for each k eN, let Yfc+i = ^fc+i — Xk. By uniformly applying 

the technique of the proof of Theorem 14.121 to a functional testifying that {Xk | A; G N) is a 
union A-sequence in ^^(a), it is routine to obtain a functional testifying that (Yfc | A; G N) 

is also a union A-sequence in J^'^(_/^y Since the sets Yq,Yi, . . . are disjoint and Xk = U^=o 
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for each A; G N, it follows by part 2 of this theorem and Theorem 14.121 that 

/ oo \ / oo ^ 

iyl[jXk\ R{A) \=iyi[jYk\ R{A) 



Kk=0 J \k=0 

oo 



k 

hm^K^, |i?(A)) 



j=0 



\j=o 

lim u{Xk I i?(A)). 



To prove part 4 of the theorem, let {Xk | A; G N) be an intersection A-sequence in ^]^(^) 
with each X^^i C X/.. By part 1 of this theorem, n^lo^^fc ^ -^^(A)' ^'^ Theorem I4.12[ 

u((^X,\RiA)] =l-u((f]x)j |i?(A) 

^fc=0 / \ \A;=0 / 

l-u([)X^,\RiA)]. 



Kk=0 



By Lemma [4.19[ the complemented sequence (X"^ | /c G N) is a union A-sequence in ■F'^f^^y 
It is clear that each X^ C Xl_^_^, so by part 3 of this theorem and Theorem 14.121 



oo 



V 



fl X, I R{A) = 1 - hm v{Xl I i?(A)) 



vfc=o 



fc— )-oo 

1 - lim (1 - v{Xk I i?(A))) 
lim z/(Xfe I i?(A)). 



□ 



Corollary 4.21. If {X\. | G N) is a A-sequence of sets, each of which has z^-measure in 
i?(A), then z^(Ur=o^fc I ^(^)) = 0- 

Proof of Corollary 14.211 This follows immediately from Lemma 14.191 and Theorem 14.201 
□ 
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Our discussion of union A-sequences and intersection A-sequences has been confined to 
tlie algebra ^^(a)- It is a routine matter to develop the analogous definitions and results for 
the algebra 



5 Measure Zero 

In this section we prove a resource-bounded generalization of the classical Kolmogorov zero- 
one law that holds in complexity classes, and we develop some useful characterizations of sets 
of resource-bounded measure 0. We begin our development with two simple consequences of 
resource-bounded measurability. Throughout this section, A is a resource bound, as specified 
in section 121 and z/ is a probability measure on C, as defined in section |3l 

Definition. Let X G C. A u-bicover of X in -R(A) is an ordered pair {d^,d^) of A- 
computable functions 

d+,d- : N X {0,1}* ^ [0,oo) 
that satisfy the following conditions for all r G N. 

(i) d^ and d~ are //-martingales. 

(ii) R{A)nx c s^[dt]. 

(iii) R{A)-X C S^[d;]. 

(iv) dt{X) + d;{X) <l + 2-\ 

If {d'^, d~) is a z/-bicover of X in i?(A), then we use the notation 

di(A) = hm rf+(A). 

r— >oo 

(This limit is shown to exist in Lemma I5.ip 

Definition. Let X G C. The martingale outer v-measure of X in R{A) is the infimum 
u°{X I R{A)) of all d{X) for which d is a A- //-martingale such that X n R{A) C S^[d]. 

Note that, for every set X C C, z/°(X | R{A)) is defined and 

< iy°{X I R{A)) < 1. 

Lemma 5.1. Let X C C, and consider the following three conditions. 
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(A) X is z^- measurable in R{A). 

(B) X has a i/-bicover in R{A). 

(C) z/°(X I R{A)) + z/°(X^ I i?(A)) = 1. 

Then (A) =^ (B) (C). Moreover, we have the following. 

1. If (A) holds and {d+,d-) is any z/-bicover of X in i?(A), then rf+ (A) = u{X\R{A)). 

2. If (B) holds and {d+, d') is an i/-bicover of X in /2(A), then d^{X) = /^°(X | i2(A)). 

Proof of Lemma 15 . 1 1 Fir st . assume that (A) holds, and let $ be a z/-measurement of X in 
R{A). Then it is easy to check that ($"'"(1), $~(1)) is a zz-bicover of X in -R(A), whence (B) 
holds. Now let [d'^, d~) be any i/-bicover of X in R{A). Then, by the Measure Conservation 
Theorem (arguing as in Lemma [4. II) . for all r G N, 

i<$+(i)(A) + d;(A) 
<<^'.^(l)(A) + (l + 2--d+(A)), 

so rf+(A) < $+(l)(A) + 2-\ Similary, $+(l)(A) < d+{X) + 2"^ so 

|<^'.ni)(A)-<(A)|<2-. 

It follows immediately that 

dtoW = = I ^(A))- 

Next, assume that (B) holds, and let (c?^, d~) be a zz-bicover of X in -R(A). The Measure 
Conservation Theorem (arguing again as in Lemma 4.1) tells us that iy°{X \ R{A)) + u°{X'^ \ 
R{A)) > 1 in any case. To see that (C) holds, let r G N be arbitrary. Then -R(A) fl X C 
S^[d+] and R{A) n X^ C S^[d;], so 

z/°(X I R{A)) + u°{X^ I R{A)) 

< d+{X) + d;{X) 

< 1 + 2-''. 

Since r is arbitrary here, this confirms (C). We have already noted that zy°(X | R{A)) < 
d+{X) for all r e N; it follows immediately that u°{X \ R{A)) < c/+ (A). To see that 
d-^iX) < iy°{X I R{A)), let d be an arbitrary A-z^-martingale such that X n R{A) C S^[d], 
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and let r G N be arbitrary. Then, by the Measure Conservation Theorem (arguing yet again 
as in Lemma [4. ip . 

1 < d{X) + d;{X) 
<diX) + il + 2-' -dtiX)), 

so d{X) > d^{X) —2^''. Since r is arbitrary, it follows that d{X) > d^{X). Since d is arbitrary, 
it follows in turn that z/°(X | R{A)) > d^{X), completing the proof. □ 

Before proceeding, we mention two examples and a lemma that further illuminate Lemma [5?T] 



Example 5.2. Consider the uniform probability measure /U on C and the complexity class 
R{p) = E. For each keN, let 

Xk = DTIME(2('=+^)") - DTIME(2'^"), 

and let X = Ufclo"^2fc- The diagonalization technique used in the proof of the Measure 
Conservation Theorem can readily be adapted to show that 

u°{X I E) = /i°(X'= I E) = 1. 

Thus condition (C) of Lemma [5.11 is not satisfied by all X C C. 



Example 5.3. Again, consider the uniform probability measure // on C and the complexity 
class -R(p) = E. For each k eN, let 

Xk = DTIME(2'=") nCofc, 

and let X = {J'^^qX^. We show in the full version of this paper that X satisfies condition 
(C) of Lemma [5.11 with /U°(X | E) = 0, but that X does not satisfy condition (B). Thus, 
in Lemma 15. 1[ condition (C) does not imply condition (B) - or condition (A) - even in the 
measure case. 



Proof of Example 15.31 

To see that X satisfies condition (C), let r G N be arbitrary. It is well-known [6] 
that /ip(DTIME(2^")) = 0, so there is a p-/i-martingale d' such that d'{X) < 2-(''+i) and 
DTIME(2™) C S^[d']. Define d" : {0, 1}* ^ [0, oo) by 

'2l^|-C'-+i) if tyC 0*^+1 



d"i 



w) 



if 



r+l 



d W 



otherwise. 

V. 
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It is easy to check that d" is a p-/x-martingale with d"{\) = 2 ^"^^^^ and S'^[(i"] = Cqt+i. 
Thus, if we let 

d = d' + d", 

then d is a p-//-martingale, 

d{X) = d'{X) + d"iX) < 2-^ 

and 

x=(\Jx)ju( U X,) 

\A;=0 / \k=r+l J 

C DTIME(2™) U Cor+i 
C S^[d']US^[d"] 
C S^[d]. 

Since X C E , it follows that 

u°{X I E ) < d{X) < 2-\ 

Since r is arbitrary here, this shows that v°{X | E ) = 0. It follows directly from this that ( 
C ) holds. 

To see that X does not satisfy condition (B), let (i+ : N x {0, 1}* — t- [0, oo) be an arbitrary 
p-computable function such that, for each r G N, is a p-/i-martingale with (i^(A) < 2^'". 
Fix /c G N such that d'^ is ri'^-time computable. Using the diagonalization technique of the 
Measure Conservation Theorem, it is routine to show that Xk+i 2 S^[dt+2\- Since X C E 
and d'^ is arbitrary, it follows that X does not have a /x-bicover in E . □ 

Lemma 5.4. For every A G REC, there exist X, y C C such that X and Y have //-bicovers 
in E and A <^ /i°(XUF). 

Corollary 5.5. There exist X, 1" C C such that X and Y have /i-bicovers in E but X UY 
does not. 

By Corollary 15.51 and Theorem 14. 121 condition (B) of Lemma 15 . 1 1 does not imply condition 
(A). This appears to suggest that, in contrast with the classical case, resource-bounded 
measurability in complexity classes does not admit a Lebesgue-style characterization in terms 
of type-1 objects. More seriously. Corollary 15.51 says that the sets having //-bicovers in E do 
not even form an algebra on E . Note also that condition (C) is noneffective, in the sense that 
there need be no concrete witness to its being satisfied. Thus the sets that satisfy condition 
(C) cannot enjoy a closure property of the type established for J^'^r/^) in Theorem 14.201 
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We now turn to the zero-one law. 



Definition. A set X C C is a tail set if, for all A, B G C, if A G X and the symmetric 
difference {A- B)U{B - A) is finite, then B e X. 

Most subsets of C that are of interest in computational complexity are tail sets. If we are 
working with a coin-toss probability measure on C, i.e., a probability measure fi^ as defined 
in section 3, then the classical Kolmogorov zero-one law |5J says that every ^-measurable tail 
set has ^-measure or ^-measure 1. (We simplify terminology by writing "^-measurable" 
in place of "/x'^-measurable," etc.) That is, if X G J-"^ is a tail set, then fi^ (X) = or 
/.^(X) = 1. 



By Lemma 14.51 the Kolmogorov zero-one law trivially implies its own generalization to 
the algebra J-'~^ . That is, if X is a A- ^-measurable tail set, then fj^{X) = or fi^(X) = 1. 

Our objective here is to generalize the Kolmogorov zero-one law to the algebra J^'^(^^y This 
generalization does not follow directly from the classical Kolmogorov zero-one law. The main 
part of our argument is the following lemma, which is a resource-bounded zero-one law for 
the martingale outer ^-measure /i^°(X | -R(A)) of an arbitrary (not necessarily measurable) 
tail set X in R{A). 

Lemma 5.6. If X is a tail set and p is a A-computable bias sequence, then /i^°(X I 
R{A)) = or iJ°{X I R{A)) = 1. 

Proof of Lemma 15.61 Assume the hypothesis, and let a = fi^°{X \ i?(A)). It suffices to 
show that a < a"^. 

Let r G N be arbitrary, and fix a A- ^-martingale d such that X fl -R(A) C S^[d] and 
d{X) < a + 2^^'^^'^\ Without loss of generality, we can also assume that d is regular (by the 

Regularity Lemma) and that d{X) < fx^ {S^[d]) + 2~^'^~^^^ (doing finite surgery on d to acheive 
this, if necessary.) 



For each n G N, let 



and fix m G N such that 



ln = {w e {0,1}* \diw) <iy 
Jn = [w e{o,ir\d{w)>i^ 
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Fix a string u G {0, 1}™ such that d{u) < d{X). (Such a string u must exist because ci is a 
martingale.) Note that 

J2 d{w)iJ{w) = d{w)iJ{w) - J2 d{w)iJ{w) 

welm 1«e{0,l}'" W&Jm 

weJm 

< d{X) - J2 ^^H 

weJm 

< d{X) - {S^[d]) - 2-^'+^^ 

J2 /^^(H < ^^'^is'[d]) < d{x). 

weJm 



and 



Using the A- "^-martingale d, the natural number m, the sets Im and Jm, and the string 
u, define d' : {0, 1}* [0, oo) as follows. Let w G {0, 1}*. 

(i) If \w\ > m and w[0..m — 1] G Jm, then 

d'{w) — d{u * w), 

where u * w is the string obtained by substituting u for the first m bits of i.e., 

\u* w\ — \w\ and 

u[i\ if < i < m 
if m < i < \w\. 



(ii) If \w\ > m and w[0..m — 1] G Im, then 

d'{w) — d{w). 

(iii) If \w\ < m, then d'(u') is defined from the values of d' on {0, l}*" so that d' is a 
^-martingale. 

It is easy to check that d' is a A- /? -martingale, (The fact that we have a coin-toss probability 
measure is crucial here in clause (i) of the definition of d'.) 

We now show that XnR{A) C S^[d']. To see this, let A G Xr\R{A). If A[0..m-1] G Im, 
then d'{A[0..n — 1]) — d{A[0..n — 1]) for all n > m. Since d is regular and A G 5'^[(i], this 
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implies that A G S'^[(i']. On the other hand, if A[0..m — 1] G Jm, then for all n > m, 

d'{A[0..n - 1]) = d{u * {A[0..n - 1])) 
= d{{u*A)[Q..n-l]), 



where it * A e C is defined by 

{u*A)[i] = 



u[i] a < i < m 
A[i] ii i > m. 



Since A e X f] -R(A) and X is a tail set, we have 

u*AeXnR{A) c S^[d]. 
Since d is regular, it now follows that A e This completes the demonstration that 

xnR{A) c s^[d']. 

Since X n R{A) C S^[d'], we now have 

a = iJ°{X I R{A)) < d'{X) = d'{X)iJ{X) 

< J2 d\w)iJ{w) + d'{w)iJ{w) 



= J2 d{w)iJ{w) + d{u) J2 /^^(^) 

W&Jm w&J — m 

< Y,d{w)iJ{w)+d{x) J]/h. 



Using the bounds we have already derived for the two sums in this last expression, it follows 
that 



a < 2-('-+2) + d{Xf 



2 



<2-('-+2) + (a + 2-('-+2)) 
< a' + 2-'. 

Since r is arbitrary here, this establishes that a < a^, completing the proof. □ 
Our resource-bounded generalization of the Kolmogorov zero-one law now follows easily. 

Theorem 5.7. If ^ is a A-computable bias sequence and X is a tail set that is 
measurable in R{A), then fj {X \ R{A)) ^ or fJ {X \ R{A)) = 1. 
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Proof of Theorem 15.71 Assume the hypothesis. Then, by Lemma \5.1\ fjJ^ {X \ -R(A)) = 
fx^°{X I R(A)), so the conclusion follows immediately from Lemma [5.61 □ 



Theorem 15. 7[ like its classical counterpart, cannot be extended to arbitrary probability 
measures on C. For example, the set X of all finite languages is a tail set, but if 

' 1 if w = A 
u(w] = {I if w G {0}+U {!}+ 



otherwise, 



then u{X) = u{X \ i?(A)) = |. 



We conclude this paper with some useful characterizations of resource-bounded measure 
sets. 

The condition uaIX fl i?(A)) = a implies the condition i/{X \ -R(A)) = a, but the 
converse does not generally hold for a > 0. However, when a = 0, these two conditions are 
equivalent. 

Lemma 5.8. For any set X C C, the following conditions are equivalent. 

(1) u{X I R{A)) = 0. 

(2) z/A(Xn/?(A)) = 0. 



Proof of Lemma 15.81 The fact that (2) implies (1) follows immediately from Lemma [4.51 
To see that (1) implies (2), assume (1). Let $ be a /^-measurement of X in R{A). Then the 
functional \1/ defined by 

vl/,,(d) = ($+(l),d) 
is easily seen to be a A-z^- measurement of X fl R{A), so 

UAiX n R{A)) = V1/+ = $+ = j,(X I i?(A)) = 0. 

□ 



We now give several useful characterizations of resource-bounded measure sets. 

Definition. A A-u-null cover oi a set X C C is a A-computable function : N x {0, 1}* — 
[0, oo) such that, for each r G N, (i^ is a z^-martingale, X C S'"'^[(ir], and d^{X) < 2^^. A 
A-z/-null cover d is regular if the martingale is regular for each r G N. 

Recall the martingale success sets S'°°[(i] and '5'^[d] defined in section [31 
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Theorem 5.9. Let X G C, and let u he a A-probability measure on C. The following 
conditions are equivalent. 



(1) z^aW = 0. 

(2) X has a A-z/-null cover. 

(3) X has a regular A-z/-null cover. 

(4) There is a A- //-martingale d such that X C S'^^fd]. 

(5) There is a A- //-martingale d such that X C 

Proof of Theorem 15.91 To see that (1) implies (2), assume that i^a(-^) = 0, and let $ be a 
A-z/-measurement of X. Then is easily seen to be a A-z/-null cover of X, so (2) holds. 

It is clear by the Regularity Lemma that (2) implies (3). 

To see that (3) implies (4), let d' be a regular A-z^-nuU cover of X. Define c? : {0, 1}* — )■ 
[0,oo) by 

\w\ if uiw) = 



d{w) 



For all w G {0, 1}* such that u^w) > 0, the trivial martingale inequality d'j.{w)u{w) < (i^(A) 
assures us that 



oo ^ oo 

d{w) = j2d:.{w)<^Y.d'w 

r=0 ^ ' r=0 



oo 



1 X — ^ ^ 2 

so d is well-defined. It is then easy to check that d is a A-z/-martingale. To see that 
X C S'^[(i], let A & X, and let m G N be arbitrary. We have two cases. 

I: There exists w ^ A such that //(to) = 0. Then, for all n > ma.x{\w\, m}, 

d{A[0..n - 1]) = n > m. 

II: i^{w) > for all w ^ A. For each < r < m, fix G N such that d'^{A[0..nr - 1]) > 1. 



(Such Hr exists because A E X C S^[d'j].) Then, for all n > maxjrir 
the fact that each d'^. is regular ensures that 



< r < m 



m— 1 

d{A[0..n - 1]) > ^ <(A[0..n - 1]) > m. 

r=0 
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In either case, we have shown that d{A[0..n — l])>m for all sufficiently large n. Since m is 
arbitrary here, it follows that A G S'^[(i], affirming (4). 

It is trivial that (4) implies (5). 

To see that (5) implies (1), let d he a. A- //-martingale such that X C S'°°[(i]. For each 
r eN andd' e V^, let 

^;id') = d'. 

It is easy to check that $ = ($^, is A-computable and that 

$ : N X ^ X P^. 

To see that $ is a A- //-measurement of X, let r G N and d' G Vy. Three things are to be 
checked. 

(i) S'^[d']nX C S^[^t{d')]- To see this, let A G S^[d']f}X. Then A G X C so there 
exists n G N such that d{A[{]..n - 1]) > 2"^ • (1 + d{X)). Then ^+{d'){A[0..n - 1]) > 1, 
so Ae S^l^tid')]. 

(ii) S^[d'] - X C This holds trivially. 

(iii) + K{d')W < d'{X) + 2-\ This holds because < 2"" and 
$-(rf')(A) = d'{\). 

We have now seen that $ is a A- //-measurement of X. Since $^(1)(A) < 2"'' for each r G N, 
it follows that v/^^X) = = 0, con&ming (1). □ 

Analogous characterizations of the sets of z/-measure in R{A) follow immediately from 
Theorem 15.91 via Lemma 15.81 

Note that conditions (2) through (5) in Theorem 15.91 do not involve type-2 functionals. 
It is these characterizations of measure sets in terms of martingales (type-1 objects) that 
have been used in resource-bounded measure to date. 
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